Adjusting dysarthric speech signals to be more intelligible

This paper presents a system that transforms the speech signals of speakers with physical speech disabilities into a more intelligible orm that can be more easily understood by listeners. These transformations are based on the correction of pronunciation errors y the removal of repeated sounds, the insertion of deleted sounds, the devoicing of unvoiced phonemes, the adjustment of the empo of speech by phase vocoding, and the adjustment of the frequency characteristics of speech by anchor-based morphing of he spectrum. These transformations are based on observations of disabled articulation including improper glottal voicing, lessened ongue movement, and lessened energy produced by the lungs. This system is a substantial step towards full automation in speech ransformation without the need for expert or clinical intervention. Among human listeners, recognition rates increased up to 191% (from 21.6% to 41.2%) relative to the original speech by using he module that corrects pronunciation errors. Several types of modified dysarthric speech signals are also supplied to a standard utomatic speech recognition system. In that study, the proportion of words correctly recognized increased up to 121% (from 72.7% o 87.9%) relative to the original speech, across various parameterizations of the recognizer. This represents a significant advance owards human-to-human assistive communication software and human–computer interaction. 2012 Elsevier Ltd. All rights reserved.